HOMOMORPHISMS FROM MAPPING CLASS GROUPS 



m , WILLIAM HARVEY AND MUSTAFA KORKMAZ 

O 
O 

£SJ ' Abstract. This paper concerns rigidity of the mapping class groups. 

We show that any homomorphism tp : Mod 9 — > Modh between mapping 
class groups of closed orientable surfaces with distinct genera g > h is 
trivial if g > 3 and has finite image for all g > 1. Some implications are 
Q\ , drawn for more general homomorphs of these groups. 
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o 

I. 

1. Introduction 

The mapping class groups resemble lattices in higher rank Lie groups in 
various ways. Along these lines, in parallel with the classic rigidity theorems 
£> \ of Mostow and Margulis, there are results by various authors restricting 

the existence of nontrivial morphisms between lattices and mapping class 
groups; for a discussion of this the reader may consult the extensive review 
f — ' article by N.V. Ivanov [Tv| . 

There are natural inclusion morphisms between mapping class groups 
of finite- type surfaces stemming from inclusions of bordered surfaces, and 
^ similarly one may show that certain ramified coverings of surfaces give rise 

to inclusions between mapping class groups of closed surfaces. However, the 
intuition remains that the closed surface mapping class groups are in some 
definite sense as distinct, for differing values of g, as possible. 

A recent result of M.R. Bridson and K. Vogtmann on the analogous ques- 
tion for automorphism groups of free groups shows that there is no nontrivial 
morphism from the group Aut F n into Aut F m when n > m > 1. In this 
paper we exploit some well-known facts about Dehn twists, together with a 
specific twist description of a torsion element of maximal order in the map- 
ping class group Mod 9 , to show that this same result holds true for Mod 9 . In 
fact our methods show that only one or two genus-dependent algebraic prop- 
erties of these groups are needed, so that morphisms into arbitrary groups 
lacking the relevant properties are automatically trivial. 
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2. Basic results on subgroups of mapping class groups 

We fix a closed oriented surface S of genus g as shown in Figure ^ Let 
Mod 9 denote the mapping class group of S, the group of orientation pre- 
serving diffeomorphisms of S considered up to isotopy. 

The Torelli group T g is, by definition, the kernel of the action of the 
mapping class group on the first homology group Hi(S; Z) of S. The choice 
of a canonical basis for H\(S;Z) gives rise to an epimorphism from the 
mapping class group Mod 5 onto the symplectic group Sp(2g, Z) and one 
obtains a short exact sequence 

1 -> T g -> Mod 9 A Sp(2g, Z) -» 1. 

Notationally, the same letter will be used for a diffeomorphism and its 
isotopy class. Similarly, we make no distinction between isotopic curves in 
a surface. 

We introduce some basic types of mapping classes and state some fun- 
damental facts about them. For a simple closed curve a on S, we denote 
by t a the (isotopy class of a) right Dehn twist along a. Two obvious sim- 
ple properties of these mappings have proved to be crucial in building up 
more intricate surface mappings and also in recognising relations between 
them. Firstly, Dehn twists along disjoint loops commute (up to isotopy): 
this makes it easy to find free abelian subgroups of rank 3g — 3 in Mod 9 , 
by choosing maximal systems of disjoint homotopically distinct loops which 
determine a pair of pants decomposition of S. Secondly, if / is any surface 
homeomorphism, then (again, up to isotopy) tf( a \ = f o t a o / . 

It is elementary that if a is a separating (i.e. null-homologous) loop then 
the Dehn twist t a is contained in the Torelli group T g . Furthermore, if a 
and b are two non-separating simple closed curves whose union bounds a 
subsurface of S, then tat^ 1 is also in the group T g ; moreover, it follows from 
Theorem 2 in jj] that if one of the two subsurfaces bounded by the union 
a U b is of genus 1, then T g is the normal closure of t a t^ 1 in Mod 3 . A precise 
converse result by Vautaw will be discussed and used in the last section. 

We shall also need to focus attention on certain torsion elements of Mod g . 
According to the classical Hurwitz-Nielsen Realisation Problem, any finite 
subgroup of Mod 9 should be isomorphic to a group of automorphisms of some 
compact Riemann surface of genus g, and a theorem of Hurwitz states that 
the order of such a group is at most 84(g — 1). The Realisation Problem was 
proved by S.P. Kerckhoff |Kej . but the case of finite cyclic groups had been 
settled much earlier by J. Nielsen and W. Fenchel. This characterisation of 
the finite cyclic subgroups of the mapping class group by surface mappings 
leads to a bound on their order. We state the basic facts we shall need about 
torsion subgroups below |W1 iHl IH2j . For more details on automorphisms of 
Riemann surfaces, the reader might consult |Bl IFKj . 

Theorem 1. 

(a) The order of any finite subgroup of Mod g is at most 84(g — 1) if g > 2. 
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(6) The order of a finite cyclic subgroup of Mod 9 is at most Ag + 2. This 
bound is achieved in every genus. 

(c) If Mod g has an element of prime order p, then either p < g + 1 or 
P = 2g + l. 

(d) There is no element of order Ag + 1 in Mod s . 

Certain geometrically defined torsion elements, including a specific ele- 
ment of maximal order in Mod 5 , first documented by Wiman |Wj in 1895, 
will feature prominently in the sequel. 

3. HOMOMORPHISMS BETWEEN MAPPING CLASS GROUPS 

As background reference and source for unexplained facts, we refer the 
reader to Ivanov's survey paper [iv] . 

Consider the system of simple closed curves (loops) ao, a±, a%, . . . , a,2 g +i 
on S as shown in Figure ^ and write tj for the twist along the curve aj. We 
let S = t\t2 • • • t2 g - Note that for the composition of two functions a and [3, 
we use the following notation: a(3 means a o /J, so that (3 is applied first. 




Lemma 2. The order of 5 in Mod 5 is 4g + 2. 

Proof. Using the elementary properties of twist maps mentioned above, it 
is easy to verify that 5(a,) = aj + i for 1 < i < 2g and 5(a2 9 +i) = ctjf : 
recall that equality for closed loops in S means they are freely homotopic. 
It follows that the order of 5 is at least Ag + 2. On the other hand, from 
Theorem^we know that the order is at most Ag-\-2. The fact that 5 4g+2 = 1 
can also be proved by a more elaborate direct computation with twists. □ 

Lemma 3. Let g > 1 and let a and b be two non-separating simple closed 
curves on S. Let N be the normal closure oft^ 1 ^ in Mod 9 . Suppose either 
that a intersects b transversely at one point, or that a is disjoint from b 
and the complement of aUb in S is connected. Then N is the commutator 
subgroup [Mod 9 , Mod 3 ]. In particular, N = Mod 5 for g > 3. 
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Proof. The proof follows similar lines to a result of McCarthy and Pa- 
padopoulos on involutions in Modg, MP . It is well-known that for g > 2 
the mapping class group Modg is generated by the Dehn twists to, ti, . . . , ti g 
about the curves ao, oti, ■ ■ ■ , a,2 g of Figure 1. When g = 1, the curve ao does 
not exist, and Modi is generated by the two twists ii,t2- We denote by T 
the quotient group Mod g /N. 

Suppose first that a intersects b at one point. Clearly, for each % = 
1, 2, . . . , 2g — 1 there is a diffeomorphism fa : S —*■ S such that fi(a) = o« 
and fi(b) = (H+i- Hence, since t^tb is in N, so is the element 

Similarly, one sees that £4 belongs to N. Consequently, all generators of 
Modg represent the same element in T, which implies that the group T is 
cyclic, hence abelian. Therefore, N contains [Mod g ,Mod s ]. On the other 
hand, since both a and b are non-separating, there exists a diffeomorphism 
k : S —>■ S such that k(a) = b. Then t~ l tb = t^ktak -1 is a commutator, 
which shows that N is contained in [Mod ff ,Mod s ]. Thus we have N = 
[Mod 9 , Modg]. 

Suppose next that a is disjoint from b and that the complement of a U b is 
connected. In this case, g must be at least 2, of course. By cutting S open 
along b, it is easy to see that there exists a non-separating simple loop c on 
S such that c intersects a transversely at one point, c is disjoint from b and 
the complement of 6U c is connected. By the classification of surfaces, there 
is a diffeomorphism / : S — > S such that f{a) = b and f(b) = c. From this, 
it follows that 

t a = t a ifr tc = t a tbfta tbf 

is contained in N. Now the conclusion of the lemma follows from the first 
case. 

For the final statement, we have g > 3, so that the first homology 
group iii(Modg;Z) of Mod g is trivial by Powell's theorem. This means 
that [Modg, Modg], which coincides with N, is equal to Modg. □ 

Our first theorem determines the normal closure of each power of 5 in 
Modg. 

Theorem 4. (a) Let k be an integer with 1 < k < 2g. The normal subgroup 
of Modg generated by S k is the full group Modg if g > 3. It has index 2 if 
g = 2 or (g, k) = (1, 1) and index 4 if (g, k) = (1,2). 

(b) If g > 3, then the normal subgroup of Modg generated by 5 29+1 con- 
tains the Torelli group T g as a subgroup of index 2. In fact it is the kernel 
of the natural morphism ip : Modg — > PSp(2g, Z), given by ip = P o ij where 
P : Sp^ PSp = Sp/{±I}. 

Proof. For each positive integer k < 2g, let Nk denote the normal subgroup 
of Modg generated by 5 k . We prove first that each Nj. contains the commu- 
tator subgroup of Modg. 
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We observe that for any k the element 

t 1 1 5 k t 1 5~ k = tiH S k( ai ) = t^Hk+i 

is contained in N^. Next we note that a\ intersects au+i = S k (a\) at one 
point if k = 1 or k = 2g, whereas if 2 < k < 2g — 1 then a\ is disjoint from 
<2fc + i and the complement of a\ U a^+i in S is connected. By Lemma El Nk 
contains the commutator subgroup of Mod 9 , the normal closure of tj l tk+i. 
It follows that the quotient Modg/N^ is abelian and hence a quotient of 
fli(Mod fl ;Z). 

For g > 3, the first homology group Hi(Mod g ;Z) of Mod 9 is trivial by 
Powell's theorem. Therefore, = Mod 9 in this case. If g = 2, the group 
-£/i(Mod2; Z) is isomorphic to Z/10Z by a result of Mumford and is generated 
by the class of the Dehn twist about any non-separating simple closed curve. 
The element 5 k represents the 4fc-th power of this generator of #i(Mod2; Z). 
Hence the quotient group Mod2/A r fc is cyclic of order 2. If g = 1, then 
Hi (Modi; Z) is isomorphic to Z/12Z, again generated by the class of the 
Dehn twist about any non-separating simple closed curve. The element 5 k 
represents the 2/c-th power of this generator of .Hi (Modi ; Z), so it follows 
that Modi/A^ is a cyclic group, of order 2 if k = 1 and of order 4 if k = 2. 
The conclusion (a) of the theorem follows. 

To prove (6), let N denote the normal closure of 5 29+1 in Mod 9 . It can 
easily be shown (e.g. by another twist calculation) that 5 2rj+l is (up to 
isotopy) a hyperelliptic involution of S, taking each loop a,j, 1 < j < 2g to 
its inverse. Thus, 5 29+1 acts as minus the identity on the first homology of 
5. Therefore, N is contained in the kernel of ip : Mod g — > PSp(2g,X). On 
the other hand, the element 

t 1 ^+V~ (29+1) =t W(ao) 

is contained in N. Now, oo and S 29+1 (ao) are disjoint non-separating curves 
whose union bounds a subsurface of genus one, and it follows from Theorem 2 
m [Jj that the Torelli group is the normal closure of such an element. Hence, 
T g is contained in N. But the hyperelliptic involution 8 2g+l is not in T g and 
the index of T g in the kernel of ip is 2. Therefore N is equal to the kernel of 
ip, proving (6). 

This completes the proof of the theorem. □ 

Remark 5. If g = 2, then since <5 5 is the hyperelliptic involution, which 
is central in Mod2, the normal closure of 5 5 is cyclic of order 2. Thus, 
Theorem Hfb) is false in this case. For g = 1, of course, the Torelli group is 
trivial. 

Lemma 6. Let g > 3 and let r denote either of the rotations r\ and r2 
illustrated in Figure Then the normal closure of r in Mod g is the full 
mapping class group Mod g . 
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(i) (ii) 

Figure 2. Two finite order surface mappings, induced by 
rotations T\ and r<i through 2n/g in (i) and 2tt /(<? — 1) in (ii). 

Proof. In order to avoid double indices, we let d denote the curve d\. Note 
that the curves d and r{d) = di are disjoint, the complement of their union 
is connected and the element t r u\ = t^rt^r' 1 is contained in the 
normal closure of r. The lemma now follows from Lemma |3 after applying 
a homeomorphism which identifies the surface in Figure 1 with that of Fig 
2; for instance we may take one which carries the curves aij— i to c,- for 
j = l,...,g. □ 

We are now ready to prove our main result. 

Theorem 7. Let g > h and let <p : Mod 9 — > Mod/j be a homomorphism. 
The image of ip is trivial if g ^ 2 and has order at most two if g = 2. 

Proof. There is nothing to prove when h = 0, since the group Modo is trivial. 
Hence we assume that h > 1, so that g > 2. 

The subgroup (5) of Mod 9 generated by 5 is cyclic of order \g + 2 as we 
saw earlier. But by Theorem ^(b), the maximal cyclic subgroups of Mod^ 
have order at most 4h + 2 < 4g + 2, and so there must be an integer k with 

1 < k < 2g + 1 such that f(S k ) = 1. We remark also that if g > 3, the kernel 
of (p contains the Torelli group. Therefore, (p factors through the natural 
map r] : Mod g — > Sp(2g, Z). That is, 99 induces a map $ : Sp(2g, Z) — > Mod^ 
such that ^r/ = 99. 

Now if the integer k, for which <p{5 k ) = 1, is less than 2g + 1, it follows 
from Theorem that the image of <p is trivial if g > 3 and has order at most 

2 if g = 2, because the normal closure of 5 fc is contained in the kernel of ip. 
The theorem follows immediately from this observation in the (simplest 

possible) case where 2g + 1 is prime. For since 2g + l is greater than 2h + 1, 
by Theorem ^ (c) the mapping class group Mod/j has no element of order 
2g + 1. Therefore we must have (p(d~ k ) = 1 for some 1 < k < 2g. This 
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completes the proof for infinitely many values of g, in particular for g = 2,3 
and 5. 

Suppose next that g > 5. Consider a symplectic basis ci, d\, . . . , c g , d g of 
Hi(S;7j) (with appropriate choice of orientations) as shown in Figure El (i) 
if g is odd and Figured (ii) if g is even. There is a subgroup T, g of Sp(2g, Z) , 
isomorphic to the symmetric group on g letters, which represents all per- 
mutations of the hyperbolic pairs (cj,dj). Let A g denote the alternating 
subgroup of T, g . Let r denote r\ if g is odd and T2 if g is even in Figure |2j 
Then the image r/(r) of the surface mapping r is contained in A g . 

The group Mod^ cannot contain a subgroup of order g\/2 when g > 5, 
because g\/2 is greater than 8A(h — 1). Therefore, the restriction of $ to A g 
is not injective, and since A n is simple for n > 5, A g must be contained in 
the kernel of <F Therefore r is contained in the kernel of cp and, since the 
normal closure of r is the full group Mod 5 , tp is trivial. 

Suppose finally that g = 4. If h = 1 then 4/i + 2 is less than 2g + 1. If 
h = 2 then 4/i + 1 = 2g + 1. Therefore, by Theorem have ip(5 k ) = 1 
for some 1 < k < 2g. The conclusion of the theorem follows in this case. 
Now let h = 3. Again, ip factors through the map r/. Consider the element 
7 = M2t3*4- A twist calculation shows that 7 10 is the Dehn twist about 
a nullhomologous simple closed curve, the boundary of S cut open along 
all these curves. Hence it is contained in the Torelli group. Moreover, the 
order of 7/(7) is 10 in Sp(8,7j). Since the prime 5 is greater than h + 1 and 
different from 2h + 1, there must be a positive integer k < 5 such that 77(7)^ 
is contained in the kernel of and so j k is contained in the kernel of ip. By 
considering the curves a± and j k (ai) = afc+i, as in the proof of Lemma |3J 
we see that the normal closure of j k is the full group Mod4. Therefore, the 
image of ip is trivial in this case too. 

This completes the proof. □ 

Remark 8. The method of proof for the general case g > 5 in the above 
theorem is a sharpening of our original one and was suggested to us by a 
conversation with M.R. Bridson. 

Corollary 9. Let g > 5 be an integer. Suppose that H is any group with 
the property that it contains no element of order 4g + 2 and no subgroup of 
order g\. Then any homomorphism ip : Mod 9 — > H has trivial image. 

Proof. The proof of Theorem applies verbatim. □ 

4. HOMOMORPHISMS FROM MAPPING CLASS GROUPS 

In this section we complete the paper by drawing further implications 
about arbitrary homomorphic images of mapping class groups. The first 
amounts to no more than an abstraction of Theorem [Tj 

Theorem 10. Let g be a positive integer. Suppose that H is a group with 
the property that it has no element of order 2g + 1. If ip : Mod s — > H is a 
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homomorphism, then the image of <p is trivial if g > 3 and is a subgroup of 
a cyclic group of order 2 (resp. A) if g = 2 (resp. g = 1). 

Proof. The hypotheses imply that there is an integer k with 1 < k < 2g 
such that <p(S k ) = 1. The normal closure Nk of 5 k is contained in the kernel 
of ip. But by Theorem 0J it is the full group Mod ff if g > 3, whereas it has 
index 2 when g = 2 and index 2 or 4 if g = 1. Since the quotient Modg/N^ 
is cyclic, the result follows. □ 

We note that if g = 2 (resp. g = 1), then there is a homomorphism from 
the mapping class group Mod 9 onto a cyclic group of order 2 (resp. 4). 

By the same method, but bringing into play the rotations rj, we obtain 
the next result. 

Theorem 11. Let g > 3 be a positive integer. If (p : Mod g — > H is a 
homomorphism, then the image of (p is trivial unless H contains elements 
of order g — 1 and g. 

Proof. Suppose that H contains no element of order g. Consider the rotation 
r\ in Figure El (i). Since the order of r\ is g, there must be an integer k with 
1 < k < g such that <p(r\) = 1. The proof of Lemma |H1 also shows that 
the normal closure of r\ is equal to Mod 5 . It follows that the kernel of ip is 
Mod 9 . 

If H has no element of order g — 1, the same argument applies, mutatis 
mutandis, with the rotation r^ of Figure El (ii) in place of r%. □ 

A further criterion for recognising homomorphic images of Mod 9 stems 
from restrictions on the rank of free abelian subgroups. Recall that if a 
is null-homologous then t a € T g , and that if b and c are two disjoint non- 
separating simple closed curves, whose union bounds a subsurface of 5, 
then t7 t c is in the Torelli group T g . A converse criterion, concerning the 
intersection of any free abelian twist subgroup with the Torelli group, is 
proved by Vautaw in V], Theorem 3.1. His result can be stated as follows. 

Theorem 12. Let c±, C2, . . . , c& be a set of homotopically nontrivial, pairwise 
disjoint, non- separating, simple closed curves on S such that for each pair 
i ^ j the surface obtained by cutting S along Ci and Cj is connected. Then an 
element t^t^ ■ ■ ■ t™£ is contained in the Torelli group if and only if = 
for all i. 

As mentioned in section 1, it follows immediately from the definitions 
that Dehn twists about homotopically distinct loops commute up to iso- 
topy, providing a natural source of free abelian subgroups, though not the 
only one. There is, however, an upper bound for the rank of an abelian 
subgroup of the mapping class group, determined by Birman, Lubotzky and 
McCarthy [BTM] . 

Theorem 13. The rank of a free abelian subgroup of the mapping class 
group Mod g is at most 3g — 3. 
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Certain specific subgroups of finite index in Mod 9 will also be significant 
here. We recall that, for any positive integer m, the congruence subgroup 
N(2g, m) of level m in the genus g symplectic group Sp(2g, Z) is the kernel 
of the natural epimorphism from Sp(2g,1i) — » Sp(2g, Z/mZ) given by the 
mod m reduction. The congruence subgroup problem for Sp(2g, Z) was 
solved by Mennicke |Mj . 

Theorem 14. If G is a normal subgroup of Sp(2g,Z) distinct from the triv- 
ial subgroup and the center, then G contains a congruence subgroup N(2g, m) 
for some m. In particular, G is of finite index in Sp(2g,Z). 

In the present context it is meaningful to ask whether the mapping class 
groups possess a similar co-finality property in relation to some natural 
infinite family of finite index subgroups. However, the range of possible 
subgroup families is considerably broader than in the case of linear groups 
such as the symplectic modular group and so far, in the absence of any 
faithful linear representation for Mod 9 , there is no natural choice. 

With this preamble we can state our final result about morphisms from 
mapping class groups, which says essentially that in order for a group to 
be an (infinite) homomorphic image of Mod 9 , it must either have a torsion 
element of maximal order or the abelian rank must be at least 3g — 3, that 
of Mod 9 . 

Theorem 15. Let g > 3 be an integer. Suppose that H is any group with 
the following properties: it contains no element of order Ag + 2 and any free 
abelian subgroup has rank < 3g — 3. If (p : Mod ff — > H is a homomorphism, 
then the image of <p is finite. 

Proof. Since H has no element of order Ag + 2, there must be an integer k 
with 1 < k < 2g + 1 such that <p(5 k ) = 1. If <p(5 k ) = 1 for some 1 < k < 2g, 
then the image of ip is trivial by Theorem ^ and the conclusion is obvious 
in this case. If ip(S h ) / 1 for all k < 2g, then ip(5 29+1 ) = 1. But then the 
kernel of ip contains the Torelli group, the kernel of r/. Therefore there is a 
homomorphism $ : Sp(2g, Z) — ► H such that &n = ip. 

It is an elementary exercise to choose a system of non-separating, pairwise 
disjoint, non-isotopic, simple closed curves c\, c%, . . . , C3 9 _3 on S g such that 

(i) the complement S\ U^^ 3 Cj is a union oi2g — 2 spheres-with-three- holes, 
and 

(ii) for each i ^ j the complement of c, U Cj is connected. 

Now the (abelian) subgroup A of Mod 5 generated by the Dehn twists about 
ci , C2 , . . . , C3 9 _3 has rank 3g — 3. Also, since the intersection A n T g is trivial 
by Theorem 1121 the restriction of ij to A is injective. Hence, 17(A) is a 
free abelian group of rank 3g — 3. Since $(17 (A)) is abelian in H and H 
does not contain any free abelian subgroup of rank 3g — 3, there must be 
a non-trivial element h S 17(A) such that <&(h) = 1. Clearly, 17(A) does not 
contain the central element —I in Sp(2g,Z). Therefore, the kernel of $ is a 
nontrivial normal subgroup of Sp(2g, Z) different from the center and so, by 
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Theorem I14| it contains a congruence subgroup. In particular, the image of 
<I> (and, hence, of <p) is finite. 

This completes the proof. □ 

5. Concluding remarks 

Our results imply restrictions on the index of any normal subgroup of 
finite index in a mapping class group for g > 3: let G < Mod g be a normal 
subgroup of finite index n, then n is divisible by g — 1, g and 2g + l. Results 
of this type may have some bearing on the notion of subgroup growth for 
mapping class groups. 

As N.V. Ivanov has pointed out, it is natural to ask a more general ques- 
tion of rigidity type, whether a non-trivial morphism (or more generally 
a morphism with infinite image) exists from some finite index subgroup of 
Mod 9 to Mod/j with g > h. The abelian rank aspect of our final result may 
have some bearing on answering this problem. We note that there are sub- 
groups of finite index in Mod2 admitting a homomorphism onto a free group 
of finite rank Ko : since Modi is virtually free, we must thus assume in this 
problem that g is at least 3. It should also be made clear that a negative 
answer to this problem would imply a positive answer to Problem 2.11 (A) 
in [Ki] . 
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